arXiv:1506.02458v2 [math.NA] 15 Sep 2015 


Very Low Truncation Dimension for High Dimensional 
Integration Under Modest Error Demand 

Peter Kritzer*, Friedrich Pillichshammert and G. W. Wasilkowski 


Dedicated to the memory of Joseph F. Traub (1932-2015) 

Abstract 

We consider the problem of numerical integration for weighted anchored and 
ANOVA Sobolev spaces of s-variate functions. Here s is large including s = oo. 

Under the assumption of sufficiently fast decaying weights, we prove in a constructive 
way that such integrals can be approximated by quadratures for functions fk with 
only k variables, where k = k(s) depends solely on the error demand e and is 
surprisingly small when s is sufficiently large relative to e. This holds, in particular, 
for s = oo and arbitrary e since then k{e) < oo for all e. Moreover k{£) does not 
depend on the function being integrated, i.e., is the same for all functions from the 
unit ball of the space. 
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1 Introduction 

This paper has been inspired by |2]. There the classical multivariate integration problem 
of approximating 

^s{f) = / f{x)dLx for large s 

d[o,iV 

was considered for functions from 7 -weighted Sobolev spaces of functions with mixed 
derivatives of order one bounded in L 2 norm. Such spaces are Hilbert spaces and have 
been assumed in a number of papers dealing with multivariate integration. In particular, 
there is a number of papers, see, e.g., [niEsiiisiEiEQiia], initiated by the work in 
that study Component-By-Component {CBC, for short) methods of constructing efficient 
lattice rules for approximating Xs(/). The authors of [2] proved that for rapidly decreasing 
weights, one can decrease the cost of fast CBC by restricting the search space for variables 
with smallest weights; however still dealing with s-variate integrals. 
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the Special Research Program ’’Quasi-Monte Carlo Methods: Theory and Applications”. 
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which is a part of the Special Research Program ” Quasi-Monte Carlo Methods: Theory and Applications”. 
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This observation motivated us to consider efficient dimension truncation and compare 
it to the technique from [2]. Dimension truncation has been considered in a number of 
papers; however, mainly for specihc integrands. Our approach is in the worst case set¬ 
ting spirit, i.e., we study truncation that depends only on the error demand £ and global 
properties of the Banach space of integrands. We consider more general weighted integra¬ 
tion problems dehned on more general classes of functions, and the proposed truncation 
technique does not depend on specihc algorithms. Moreover, for some classes of weights, 
when the corresponding integration problem is well dehned, see, e.g., [HI |8l UHl [23] , s could 
be inhnite. 

More precisely, we consider approximating 

W) = f fix)ps{x)dx, 

J D’’ 

where D can be an arbitrary (bounded or unbounded) interval, p is a probability density 
function on D, and 

S 

Ps{x) := JJp(Xj) for a; = (xi,... ,0;^). 
j=i 

As for the spaces of integrands /, we consider both anchored and ANOVA spaces (denoted 
respectively by and of functions with mixed hrst order derivatives bounded 

in -^-weighted Lp norm. These are Banach (as opposed to Hilbert) spaces and were 
considered in a number of papers including ^ [23] • Their dehnitions and properties are 
recalled in Section 2. Here we briehy show the norm for the anchored case 

\ i/p 

Wxj) dxj) J . 

Here is a positive (a.e., on D) probability density function, the summation is with 
respect to the subsets u of [s] = {1 ,..., s} (when s = oo the summation is with respect to 
all hnite subsets of N), and 0_u]) denotes the mixed partial derivatives Hjeu ^ 

of / with values of xj for j ^ u being zero. Finally, 7 u are non-negative real numbers that 
quantify the importance of sets x^ = {xj)j^u of variables. 

We show that for the anchored spaces with large s, if the weights decay sufficiently 
fast then it is possible to approximate the original s-variate integral by the following 

fc-variate integral 

Xkifk), where fk{xi,... ,Xk) := f{xi,... ,Xk,0,... ,0). 

This is because for a modest error demand e, one can compute k = k{e) such that 

k{e) s and \Is{f)-Xk(e){fk{e))\ < for all / G (1) 

Actually, the truncation error in ([1]) is slightly smaller 

\Xs{f) -Xk{fk)\ < 21-l/p 11-^ “ fkWPs^p,-,- 


Fs.v.'y 


V u jeu 
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Therefore for any fc-variate rule Ak for approximating integrals from the space Tfc,p ,7 with 
the worst case error bounded by 


the resulting s-variate quadrature Ql]p'^-y, dehned by 

Qt^-yif) ■■= Mfk), 

has its worst case error bounded by 

< e. 

Since for modest values of £ the truncation dimension k{e) is small, the approach 
suggested in the current paper could lead to very efficient ways of dealing with integrals 
that have a huge (including cxd) number of variables. We illustrate this for the classical 
integration problem {D = [0,1] and -0 = p = 1) and special product weights 

7 u = with a > 1. 

jeu 

(For such weights the space F’s,p ,7 and the integration problem are well dehned even for 
s = oo, see, e.g., [23].) Then 

k{e) = O (£-V(a-i+i/p)) . 

For instance for p = 2 and a = 2, some values of k{e) are listed below 


e 

10-1 

10-2 

O 

1 

CO 

O 

1 

k{e) 

4 

17 

77 

357 


and they are surprisingly small for modest error demand e. They are even smaller for 

p = 1: 


£ 

10-1 

10-2 

o 

1 

CO 

O 

1 

k{e) 

3 

9 

31 

99 


More values of k{e) are provided in Example 0] and it is clear that the larger a or the 
smaller p the smaller values of k{e). 

We also show there that for the normalized worst case error, the corresponding values, 
denoted by /c“™(£), are even smaller. For instance for p = 2 = a, we have 


£ 

10-1 

o 

1 

to 

o 

1 

CO 

10-^ 


3 

15 

69 

322 


These results depend very much on special properties of anchored spaces and do not 
hold in general for ANOVA spaces with arbitrary weights. However, for product weights 

Tu = IT'-v 

jGu 
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we can use the following fact due to [6]. The corresponding anchored and ANOVA spaces 
are equal (as sets of functions) and their norms are equivalent with the equivalence con¬ 
stant bounded by 

S 

n(i+7j«) 

j=i 

for a number k that depends on p and (Note that if 7j < then the equivalence 
hold also for s = oo.) Of course, when this constant is not too large, efficient algorithms 
for the integrands from -F<j,p ,7 are also efficient for integrands from Hs p j. 

To simplify the presentation, from Sections 2 to 6, we deal with the classical integration 
problem and hnite s. Basic concepts are presented in Section 2. The results on the 
dimension truncation for anchored spaces are in Section 3. In Section 4, we apply recent 
results, see [3 El [ID], on the equivalence of anchored and ANOVA spaces for product 
weights so that the truncation technique from Section 3 can be used for ANOVA spaces. 
Moreover, we improve the result of [7] by providing in Theorem |6] the exact value of the 
embedding operator for p = 2 from the anchored onto ANOVA space. We next use the 
above truncation results in Sections 5 and 6 to derive a more efficient fast CBC algorithm. 
Generalizations of results from Sections 3 and 4 are presented briefly in Section 7; they 
rely on the same proof techniques. 

Finally we want to add that the worst case approach to the effective dimension in both 
the truncated and superposition sense is considered in |T8]; however, only for weighted 
Hilbert spaces {p = 2) of periodic integrands with D = [0,1]*. Moreover, the effective 
dimension is dehned in terms of variances of the components from (classical) ANOVA de¬ 
composition of functions. Although the results of [TS] are very interesting from theoretical 
point of view, they are not explicitly related to the errors of algorithms. 

2 Basic Concepts 

2.1 Anchored and Unanchored Spaces 

In this section, we introduce the basic definitions of the anchored and unanchored (ANOVA) 
Sobolev spaces of s-variate functions. More detailed information can be found in [HI ITOl 
[23]. 

Here we follow [23l Section 2]: For p e [1, cxd] let F = HVo([ 0,1]) be the space 
of functions dehned on [0,1] that vanish at zero, are absolutely continuous, and have 
bounded derivative in the Lp norm. We endow F with the norm ||/||_f = ||/^||l for 
/eF. 

For s G M and 

W := {1.2..... 4. 

we will use ti,u to denote subsets of [s], i.e., 

0 , u C [s]. 

Moreover, for x = (xi, X 2 , ■ ■ ■, Xg) G [0,1]® and u C [s], 0_u] denotes the s-dimensional 


4 


vector with all Xj for j ^ u replaced by zero, i.e., 

[a;u;0_u] = (|/i,|/ 2 ,... ,2/s) with yj = 

We also write to denote the |u|-dimensional vector [xj)j^u and 

= = /*=/■ 

OXu ^ ^ OXi 

jeu J 

For s G N and nonempty u C [s] let be the completion of the space spanned by 

/(*) = n, Gu fj ^ ^ ^ ~ {xi,..., Xs) G [0,1]®, with the norm 

II/IIf. = l|/'"'iu,. 

Note that F[, is a space of functions with domain [0,1]® that depend only on the variables 
listed in u. For u = 0, let be the space of constant functions with the natural norm. 

Consider next a sequence 7 = (7u)uc[s] of non-negative real numbers, called weights. 
Since some weights could be zero, we will use 


f X, if ?' G u, 

I 0 if j ^ u. 


it = {u c [s] : 7u > 0} 

to denote the collection of positive weights. For p G [1, cxd], we dehne 


Fg^p = span 


^UGil / 


The corresponding weighted anchored space is the completion of Fg^p with respect 

to the norm 

i/p 


Eucp] ll/^“n[-u;0-u])||Lj ifp<cx), 

maxu6[,] esssup,^^g[o,i]|u| \ f^''\[x^-, 0_u])| ii p = 00 . 
For 7 u = 0, the corresponding term O-J) = 0. We then have 


i/p 




For p = 00 the norm reduces to 


F = max 

s,oo ,7 


— esssup |/(‘‘)([a;u;0_u])| . 
7u a;uG[0,l]l“l 


More information on the structure of the space Fg^p^^ can be found in [221 Section 2]. 
An important class of weights is provided by product weights 


7. = If'-j 

j€u 
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for positive reals 'jj. When dealing with them, we will assume without any loss of gener¬ 
ality that 

1 > 7i, and 7^ > 7^+1 > 0 for all j. 

Note that for product weights we have if = 21^] = {u ; u C [s]}. 

For p = 2, is a reproducing kernel Hilbert space with kernel 

K\x,y) = 

uGU j Gu 

for a; = (xi,..., Xg) and analogously for y, which for product weights reduces to 

S 

y) = JJ (1 + 7| mm{xj, yj)) . 

The weighted unanchored (or AN OVA) Sobolev space is the Banach space of 

continuous functions / : [0,1]^ —)■ M with hnite norm 


Hs 


Ei 

.UGU 




f^“Hl-u;X-uJ)dx_^ 


1/p 


For p = 00 the norm reduces to 


H.,^,^ = max— ess sup 
7u a;ue[0,l]l“l 


f^''\[x^;x_^])dx_^ 




For p = 2 and product weights, Hg^ 2 ,y is a reproducing kernel Hilbert space with kernel 
function given by 

S S 

K{x,y) = YlKy.{xj,yj) = JJ(1 + 7|(|H2({xj - %■}) + {xj - l){yj - i))), 

i=i i=i 

where -82(0;) = x^ — x + ^ is the second Bernoulli polynomial and {x} = x — [xj. 


2.2 Algorithms and Errors 

We consider algorithms that use a hnite number n of samples f{xi). Without loss of 
generality, see, e.g., |22], we can restrict the attention to linear algorithms, called quadra¬ 
tures, 

n 

QsAf) = 

i=l 

for Oi G M and Xi G [0,1]®. An important class of quadratures is provided by quasi-Monte 
Carlo methods with all coefficients Oj = 1/n (see, e.g., [3l |5l [HI US]). 

We consider in this paper the worst case error dehned by 

c(f?s,n) Fg,p,y) 11^5 Qs,n|| SUp |Xs(y) Qs,n(^f)\- 

\\f\\Fs,p.-y<^ 
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It is well known that the operator norm ||Xs|| = snp||j||^ \Xs{f)\ of Xg is eqnal to 


III. 


/ p* \ hp* 

(Eugh 

maxugu 7 u for p = 1 , 


see, e.g., |23]. Here p* is the conjngate of p, i.e., 


1 

p 


+ 


1 

p* 


1 . 


( 2 ) 


In the case of product weights the formula 


iii.il = 


= n- 1 + 


P*+i 


max„cHn,Gu7j 


can be rewritten to 

i/p* 

for p > 1 . 
for p = 1 , 


Of course, since we assumed that all 7 ^ < 1 then the maximum above is attained by u = 0 
and is in fact equal to 1 . 

The dehnitions of the errors for the space are similar. The norm of the in¬ 
tegration operator with respect to the space is also equal to the right hand side 

of ©. 


3 Anchored Decomposition and Truncation 

It is well known, see, e.g., [13], that any / G Fg^p^^ has the unique anchored decomposition 

f = P) 

ugU 

where /u is an element of Fy, depends only on Xj for j G u, and 


/u(cc) = 0 if Xj = 0 for some j G u. 


(4) 


For the empty set u, is a constant function. We stress that in general we do not know 
what the elements /u are and we can only evaluate the original function /. 

The anchored decomposition has the following important properties, see, e.g., [ 8 |: 

/<">(K;0_J) ^ /<“>. (5) 

Due to (jl]) we have 

/, ^0 iff /H([.,;0_J) ^ 0 , 

and due to (I3|) and (I5|) 
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and 


F«,oc,^ = max- 

uell 7 ^^ 


for p = oo. 


For any u 7^ 0, there exists (unique in Lp-sense) g G -hp([0, such that 
fn{x) = [ g{t) T\lio^^p{tj)dt and = g, 

where lj(t) is the characteristic function of the set J, i.e., lj(t) = 1 if t G J and 0 
otherwise. 

Moreover, for any u, 

/([•«; o-j) = 

oCu 

In particular, for k < s we have 

f{[x[k];0_[k]\) = /(a;i,...,a;fc,0,...,0) = ^ f„{x) (6) 

t3C[fc] 

which allows us to compute samples and approximate the integral of the truncated function 

fk{xi,...,Xk) = ^ U{x). 

uC[fc] 

Moreover, fk G Fk^p^-y C Fg^p^-y and 

WfkWPk^p^^ = ||/([•[fc]; 0-[fc]])||F,,p,.., = X] /u 


For given k E [s], let Ak^n {n G N) be a family of algorithms to approximate integrals 

^k{g) = / 9ix)dx 

for functions from the space Fk,p,-y. We use them to dehne the following quadratures for 
the original space Fg^p^-y 

QtS(/) = .4*,„(/(l.|n;0_|n])) = A,Mk)- m 

Clearly, the quadratures Q^gn\ dehned. 

We have the following result. 

Theorem 1 For every k G [s] the worst case error of bounded by 


e(QXnM < ' |e(A.,„; ^ 


{p* + 1)1“! 


for p > 1 


and by 


^^>1,7) ^ max ( e{Ak^n] , maxyu ) forp= 1, 

V / 


where in the case k = s we set maxugpj 7u := 0. 



Proof. We prove the theorem for p > 1 only since the proof for p = 1 is very similar. 
For any / G 


\Uf)-QZ:k{f)\ = 


^k{f{[-[k]] 0-[fc]])) - ^fc,n(/(hfc]! 0-[fc]])) + X] 


\><g[k] 


< e{Ak^n, Fk^p^-f) \\fk\\Fk,p,^ + ^ \Fsifv)\- 

og[k] 

Since has the tensor product form and depends only on |ti| variables, 


|I.(/.)I < II/.IIf. 


sup |Xi(/)| 
/G^’{1} 




= II 


(b)| 


y 


'P (j)* _|_ 1 )| d |/ p ‘ ’ 

where we used that sup /eF{i} |2^i(/)| = ■prrYWF^) which can be checked easily. Therefore 


mk] 


t)g[fc] 


(j)* _|_ i)it)i/p* 

i/p 


i/p* 


.mk] 


(b)||P 

Lr> 


,mk] 


7d 


(p* + 1)1”! 


Hence putting together, we get 


i/p 


\Uf)-QtnW)\ < 

^uC[k] 

1/p* 


1/p 


E 

,ug[fc] 


7? 


(p* + l)l“l 


E ^"■'' 11 / 711 ’ 

,ug[fc] 


Finally, using the Holder inequality one more time, we get 

\uf) - Qz:kif)\ 


i/p 


i/p* 


< E Ti' IlF 


)IIP 


u2b] ^ ^ 




This completes the proof. □ 

We now apply this theorem to product weights. First we prove an upper bound on 
the truncation error. 
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Proposition 2 Consider product weights 7 u = k < s. The truncation error 

is bounded by 





{p* + 1)1“! 


i/p* 


< III. 


-3 


5 


""P ' 2(7TT) ^ 

> j=k+i 


i/p* 


for p > 1, 


and it is equal to 


max7u for p = 1 . 
um 


Proof. The proof for p = 1 is trivial. For p > 1, we have 


fo* + ^ (v* + ^ (v* + 

u2[fc] ’ uC[s] > uC[fc] > 


7S' 


y _ 7l _y 

_i_ 1 hui 


7f 


n 1+ 


P 


S 


nh+ 


i=i 

mf 


p* + 1 

jL 

p* _i_ 1 


n 1 


+ 


p 


i=i 


p* + 1 


n 


p* +1 


r +1 + 7 ; 


1 - 


p* +1 


,SiP* + l + 7f 


We have 


n 


p* +1 


p* +1 + 7 ^ 

j=k+i ^ ^ ^ 'j 


= 1 - exp I ^ log 


p* + 1 


° p* + 1 + 7 ^ 
7=fc+i ^ ^ ^ b 


= 1 


exp I ^ log 11 - 


7, 


Vj=fc+i \ 

where log denotes the natural logarithm. Note that for x G [0,1/2], 

log(l-a;) = + ^ + -^ > -X (1 + ^ {l + X + x"^-\ - 

/ .. \ o __ 


p* + 1 + 7^ 


= -X [1+ 


> - 


V 2(l-a;), 

Since we assumed that the product weights are bounded by 1, 
to the above expression, and therefore 

p* + 1 


we can apply this estimate 


n 


p* +1 + 7I’ 

j=k+i ^ ^ ^ b 


< 1 — exp 


7^ 


y ■ 


< 1 — exp 


-3 


This completes the proof. 


2(p* + l) ^ 

. > j=k+i 


E 


□ 
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We have the following corollary. 


Corollary 3 Consider product weights and k < s. For p > 1, we have 


e{Q 


itrnc . p 


) < [e{Ak,n;Fk,p,^)f + \\X, 


1 — exp 


-3 


2 {p* + 1 ) 



j=k+l 


1/p* 


and forp = 1, we have 

^.,1,7) < max {e{Ak,n, , 7^+1), 

where 7^+1 = 0 if k = s. 

Therefore, for the worst case error of Qfn% exceed the error demand e > 0, it 

is enough to choose k = k{e) so that 


1 — exp 




Ti 


< 


{e/m\r 


2ip* + l) ^ \ - 

> j=k+i 


(or'-^k+i < £ forp =1), and next to choose n = n{e) so that 

-^^,1,7) ^ 2i/p* ■ 

Clearly the inequality (jH]) for p > 1 is equivalent to 


E s 


2 (p- + 1 ) 7 _ 


j=k+l 


Example 4 Consider large s including s = 00 and 

7u = ® 


jGu 


Recall that then 


p.ii = n(i+ 


i=i 


J 


:—ap 


P* + 1 


1/p* 


for p > 1 and ||Xs|| = 1 for p = 1. Hence it is enough to take 

k{e) = — 1 ] for p = 1 . 

For p > 1, we have 
{k + 

-- = I X ' ux ^ 

j=k+l 


ap* — 1 


poo ^ p 

/ dx < V < / 

Jk+i Jk 


( 8 ) 


(9) 


x-F^ 

k+ 1/2 ap* -1 


Therefore, to satisfy ([9]), it is enough to take 
k = k{e) = ' ' 


2{p* + 1 ) (ap* - 1 ) log(l - (£/||X,||)p 72 ) 


l/(ap*-l) 


for p > 1 . 
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For p = p* = 2, which corresponds to the classical Hilbert space setting, we have 

k(e) = f(-2(2o-l)log(l-(£/||I,||)V2))-W“-'>-il. 

In calculating the values of k{e), we slightly overestimated the norm of in the following 
way 


III, 


•s II _ 


< n(i+ 


—2a 


s nh+ 

j=i \ 

= n(i+ 

j=l V 


3 

—2a 


3 

—2a 


i=i ^ 
'1 


—2a 


exp 


3 

dx 


exp 


oo 


E 

vi=4 


exp 


'3.5 

1 


3 (2a - 1) 


3.5 


-2a+l 


This gave us the following estimations for HX^p for p = 2: 

1.3703 for a = 2, 1.3411 for a = 3, 1.3352 for a = 4. 

Below are values of k{e) for a = 2,3, 4. We have 

in-5 in-6 

for a = 2, 
for a = 3, 


and 


e 

10-^ 

o 

1 

to 

10-3 

10-1 

10-3 

10-3 

k{e) 

4 

17 

77 

357 

1659 

7701 

e 

10-1 

10-2 

O 

1 

CO 

10-1 

10-3 

10-3 

k{e) 

2 

6 

12 

31 

77 

193 

e 

10-1 

10-2 

O 

1 

CO 

10-1 

10-3 

10-3 

k{e) 

2 

3 

6 

11 

21 

41 


for a = 4. 


It is clear that k{e) decreases with increasing a. It also decreases when p decreases as 
illustrated below for p = 1: 


for a = 2, 
for a = 3, 


and 


e 

O 

1 

10-2 

10-3 

10-1 

10-3 

10-3 

k{e) 

3 

9 

31 

99 

316 

999 

e 

10-1 

10-2 

10-3 

10-1 

10-3 

10-3 

k{e) 

2 

4 

9 

21 

46 

99 

e 

10-1 

10-2 

o 

1 

CO 

10-1 

10-3 

10-3 

k{e) 

1 

3 

5 

9 

17 

31 


for 0 = 4. 


We end this section with the following remark concerning the normalized worst case 
error. In a number of papers on tractability of integration, instead of the standard worst 
case error the normalized one is used. It is dehned by 


-F ) ■ = 


c(Qs,nj 

ra ' 


It follows clearly from Corollary [3] that the following is true for product weights. 
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Corollary 5 Consider product weights and k < s. For p > 1, we have 


i/'/^trnc .77 \ ^ 

Ws,n,k^ S 




III. 


+ 1 — exp 


p 

2(p* + 1) ^ 

' j=k+i 


E 


i/p* 


Note that for any p and any weights 



< 1 . 


The corresponding numbers for which the normalized truncation error is 

bounded by 6 / 2 ^/^*, 


i/p* 


1 — exp 


~3 ^ p* 

2(p* +1) 


< 


21/p* ’ 


are smaller than k{e) since for product weights HX^H > 1. For instance, for p 
we have 


£ 

0 

1 

0 

1 

to 

10-3 

0 

1 

10-^ 

10-3 ^ 

£ 

3 

10-^ 

15 

10-2 

0 

CO 

322 

10-^ 

1494 

10-3 

6334 ® 

10-3 ^ 

and 

e 

2 

10-^ 

5 

10-2 

0 

1 

CO 

29 

10-^ 

72 

10-3 

182 “ 

10-3 „ 


1 

3 

5 

11 

20 

39 “ 


2 and 7 ^ 


4 ANOVA Decomposition and Truncation 

It is well known, see, e.g., |T3], that functions h G Hg p -y also have a unique decomposition 

h = 

ueii 


where each h^ depends only on the variables Xj for j G u, and 

1 

h^{x) dxj = 0 if j G u. 

Unfortunately, unlike in the anchored decomposition, the terms and X]uc[fc] < s) 
cannot be sampled. This means that the truncation approach presented in the previous 
section would not work in general since one cannot get sharp estimations of the worst 
case truncation error 



sup 




x.(h) 



... ,Xfc,0,... ,0) d(a;i, ...,Xk) 
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However it works for product weights with sufficiently fast decaying y^’s. This is why 
we assume for the rest of the paper that the weights have the product form. 

For product weights, the spaces and Hg p -y (as sets of functions) are equal, see 

[S]. Moreover the embedding 

, -17 ^ H 


and its inverse 

boundecii]- Indeed, it was shown in [7] that for p = 2 we have 


■ H ^ F 

~ s^p^'y 


are 


max (|h., 2 ,^|| , ||*J,^||) < n ( ^ ^ 

j = l ^ V 

Next, it was shown in [8] that for p = 1 and p = oo 


2\ 1/2 


bs,i,7ii = ib.pVii = 

i=i 


l*s,oo,7|| — |bs,oo,')'l 


n(i+''^/2) 

i=i 


Finally, the authors of [TO] showed, applying the theory of interpolation to the above 
result, that for every p G [1, oo], we have 


max(||?,,p,^||, < n^^ + Ti)- 

i=i 


The following theorem provides for p = 2 the exact value of the norms of the embed¬ 
dings ^s,p,'Y and and shows that these norms are equal. 

Theorem 6 Consider product weights. For p = 2, 


Moreover 


^s>2,7 I 




-1 I 

s,2,7 I 



( 10 ) 


Vi 6 



< 


1 + ^ + 1 + ^. 

\/3 6 24 Vs 


( 11 ) 


Proof. Since the spaces and Ps, 2 ,-y are tensor products of the corresponding spaces 

of univariate functions, it is enough to prove flTUD for s = 1 and a generic weight g G (0,1]. 
Moreover we will only consider ||/||hi, 2 , 9 /II/I|fi, 2 .<, since the proof for ||/||fi. 2 , 9/11/11^1.2,3 is 
very similar. 

^Let F and H be normed spaces with norm || ■ ||_f and || ■ Iffi, respectively. We say that F is continuously 
embedded in Ft and write F ^ H, ii F <Z H and if the inclusion map i : F ^ H, x ^ x, is continuous, 
i.e., if there exists some (7 > 0 such that < C||a;||F for all x £ F. 
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Note that for f = c, ||/||_h'i, 2 , 9 /II/II-Fi, 2.9 = 1- Hence it is enough to consider 


f[x) = -+ h(t) dt 

9 Jo 


for some c > 0 and ||h||i 2 = 1. Then 


t,.. = s-^ (1 + ■ 


Moreover 

rl 


f{x) dx = —h / h{t) {1 — t) dt < - ( c + 


'0 


9 Jo 


9\\r^\\L2 

Vs 


c + 


9 \ Vs 


( 12 ) 


and, therefore, 


2 

^^1,2,9 




9 


Hence 


Hi, 2 ,g ^ V + g/VsY + 1 _ + 1 + 2 g c/Vs + /S 9 / \ 

C2 + 1 “ C2 + 1 “ 


2 

-^1.2,9 


where 


2c + g/Vs 

= e^ + 1 ■ 


It is easy to verify that 


9^ 9 


and then 


maxp(c;c/) = p(c*;^), where c* = ^ 1 + — - ^ 


«.,=. < i + ^9(c-9). 


2 

■^1,2,9 


This shows that ||«i, 2 ,g|| <1 + 5 '/VS p{c*g] g). To prove equality it is enough to notice that 
for h{t) = Vs (1 — t) we have equality in flT2l) . i.e.. 


This proves that 


h{t) (1 -t)dt = 


ll+,2,gr - ' 


(13) 


We now show that p(c*; g) = a/1 + 5^/12 + g/ \/l2. It is easy to verify that 

^ 1+7712 _ 1 


pi.V]9) = 


1 + gyi2 - ^l + gyi2g/V^ V^+W^l - g/V^' 
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Therefore, applying the conjugate to the last fraction we get 




^l + g^/l2 + g/V^ ^ g^ 


yrTWl2-VWl2 ^l + gyi2 + g/VT2 

We now prove flTT]) . The hrst inequality is trivial. Clearly 


= f 1 + 


+ 


12 ^/T2‘ 


9 

^/3 


9 9 

l + ^ + 


12 712 


9,99 , /i , r . 

73 73 1^712 V ^12 

7! T + 


where 


^(7 : = 


9 

73 


1 + ^-1 
12 


Of course the term E{g) is nonnegative, a can be upper-bounded by 

9 7/12 7 2 ^ ^ 


m = 


< 


73 71 +c /712 + 1 24 73 71 +c /712 + 1 24 73 ‘ 


Consequently, 


1 + 


73 


9 9 

l + ^ + 


12 712 


9 9 

< 1 + 7= + ^ + 


73 6 2473 ’ 


(14) 


which completes the proof. 


□ 


The importance of the fact that the corresponding embeddings are bounded is captured 
by the following corollary. 


Corollary 7 For every integration rule Qs,n we have 


(^{,Qs,n) 7s,; 


pa/ — 




s^n-! and c(7s,n7 -^s,; 


pm — 


s,p,~/ 


^(^Qs,m 7s,p,"/)' 


The essence of this corollary is that, for small max(|7_p_-|,||, 777 II)’ algorithm with 
small worst case error with respect to one space has also small worst case error with 
respect to the other space. In particular, a good truncation in the space leads to 

efficient algorithms for i7s,p,-y. 

We end this section with the following remark. 


Remark 8 If 

CXD 

< 00 , 

i=i 

then the norms of the embedding operators are bounded independently of s. 
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5 CBC Construction of Folded Lattice Rules for In¬ 
tegration in Fg 2,7 and 2,7 


Now we consider folded (also called tent transformed) lattice rnles. Thronghont this 
section we only consider prodnct weights and p = 2. Note that then p* = 2 and for the 
exponent in Proposition [2] 

3 _ 1 

2 {p* + 1) 2 


For n G N and z G a lattice rnle with n points and generating vector z is a 
qnadratnre rule of the form 


^„,(z)(/) = i|)/({fz}), (15) 

where the fractional part {(/c/n)z} of is meant component-wise. Lattice rules are es¬ 
pecially suited for the integration of 1-periodic, smooth functions (e.g. from Korobov 
spaces), for which there exist excellent error estimates [51 [T31 HSl EH]- These results can 
also be transferred to non-periodic functions when one replaces lattice rules by folded 
(or tent transformed) lattice rules. The tent transform 0 : [0,1] —)■ [0,1] is a Lebesgue 
measure preserving map given by (p{x) = 1 — |1 — 2x\. For a vector x G [0,1]^ let (p{x) be 
dehned component-wise. Then the folded version of flTHl) is given by 





(16) 


The idea of using folded lattice rules was hrst introduced by Hickernell in [5]. 

For the worst case error of a folded lattice rule in the unanchored Sobolev space Hs 2 ,-y 
it follows from jH Lemma 1 and lines 11-13 on page 277] that 


< e(A„(z); 


(17) 


where vr ^7 = (tt ^I“l 7 u)uc[s]- For a > 1 the Korobov space is a reproducing kernel 

Hilbert space of 1-periodic functions with kernel function 


^s,a,7(a;, y) = '^ rih) exp{2nih ■ {x - y)). 

fiez® 


Here, for h = {hi, h 2 ,..., hg) G r{h) = for h G Z we put 


1 if h = 0 , 
if h ^ 0 . 


Hence the worst case error of a lattice rule in dominates the worst case error of 

the folded version of the same lattice rule in i 7 s, 2 , 7 r 2 'y (whose elements are not necessarily 
1 -periodic). 
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There are a lot of results concerning the worst case error of lattice rules for Korobov 
spaces. Excellent generating vectors can be constructed component-wise with so-called 
component by component (or, for short, CBC) algorithms. The CBC approach goes 
back to Korobov m in the 1960s. Later it was re-invented by Sloan and Reztsov 
in 2002 and became a powerful tool in constructing lattice rules for high-dimensional 
problems. We refer to for the CBC construction and HSIE] for the fast 

CBC construction according to Cools and Nuyens. 

For example, for product weights we have the following result which is essentially [3l 
Theorem 5.12]. 

Theorem 9 Let n be a 'prime number and consider product weights ^ = Hjeu 
can construct with a fast CBC algorithm a lattice point z G {0,1,..., u — 1}^ such that 

/ . \ i/(2A) 

e(A„,.(z)i (-1 + 11(1 + 2ef C(Aa)) j (18) 

for all A G (l/o, 1], where ( denotes the Riemann zeta function, C(ck) = 
construction cost of the fast CBC algorithm is of order of magnitude O(sn log n). 

/,From Theorem [9] in conjunction with flT7|) and Corollary [7] we obtain the following result. 


Theorem 10 Let s & N be given and let n be a prime number. If z & {0,1,..., n — 1}® 
is constructed such that (na holds, then for all A G (1/2,1] we have 




Jl 

T^2 


2X 


C(2A) 


1/(2A) 


and 


^s,2,-f) < |bs,2' 


(n 


1)1/(2A) 


-i+n(i+2((/) 

1=1 


2A 


1/(2A) 


Hence we have a fast CBC construction of quadrature rules for the unanchored space 
Lfg 2,7 and for the anchored space T/ 2 , 7 - 


6 Truncated Quadrature Rule for i/s,2,7 and ^§,2,7 Based 
on Folded Lattice Rules 

Now we combine Theorem m with the truncation in the sense of ^ 5 , 2 , 7 - For the k- 
dimensional quadrature rules we use folded lattice rules satisfying ( 1 T 8|1 with s replaced by 
k. We deduce the following theorem from Corollary [3], Corollary [71 and Theorem ITOl 
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Theorem 11 Let s E N be given and let n be a prime number. Let k eN be chosen such 
that k < s. If z E {0,1,... ,n — 1}^ is constructed such that flT 8 |) with s replaced by k 
holds, then for all A G ( 1 / 2 , 1 ] we have 


eiQtn^k, Fs,2n) < 


hk,2a\? 

l)i/A 


[n 


■i+n(i+2(S)''«2A) 

i=i A 


1 1/2 


+ ||I,||^ (l-exp(-- 

j=k+l 


(19) 


and 


(^iQsZ%Fs, 2 ,j) < lb,,2,7! 


Ibfc,2,' 


[n 


1)1/A 




l/A 


1 1/2 


+ ||I,f (l-exp(-- 

j=k+l 


( 20 ) 


Remark 12 Note that the truncated quadrature rule and fl20|) . respectively, 

can be constructed using 0{kn\ogn) (as opposed to O(snlogn)) operations. 

Let us now discuss the bounds in flT^ and (1201) . We assume that s is huge and that 
the product weights 7 satisfy the condition 

00 

5^7i<oo- (21) 

i=i 

Furthermore, recall that 7 ^ < 1 for all j E M. From this and, by Theorem [ 6 l and standard 
arguments, we get 


bs,2,7l| — lb, 


Similarly, we see that 

k 


1,1, 1 ^ 


Til" < nb+v(^+5 + 24^y 

s 

n (1 + 0.7681 ■ 7j) 


< 


i=i 


< exp I 0.7681 • ) =: C'i(7). 

i=i 


n (1 + 2 (^)'' b/xOSA) EtIM C.ii, A), 


i=i 


/=! 


III. 



< exp 




< C^i(7). 
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and 










In summary, we obtain from (fT^ that 

Ci(7)C’h(7.A) 




(n- 1)'/A 


+ Ci(7)(l-exp(-- 5^ 7| 

j=k+l 


(22) 


and from fl 20 l) that 


|e(osi; < ^^7)r^ryi^ + cf(7) li-expl-i 5; y 


j=k+l 


< 


Ca{iA) , ^2 


n 


l/A 


+ CJ( 7 ) l-exp -- ^ 


7| 


j=k+l 


where 


C4(7,A) = 2‘'"CJ(7)G‘''"(7,A). 


Let now G : M"*" M'*' be a strictly decreasing bijective function with lima,^oo G{x) = 0 

such that 

OD 

G{k) > 7 | for ken. 

j=k+l 

Note that G exists due to the assumption in fl 2 T|) and also G~^ exists and is strictly 
decreasing as well. Then we obtain from fl22l) that 


[eWSii < ^.(7) + (1 . 


Now we choose k such that 


2 a 




l/A 


n ) 

For n > 2 6 * 2 ( 7 , this is satished if 

'2C2(7.A)A‘'" 


1 _ Q-Gik)/2_ 


G{k) X -2 log 1 - 


n 


2C2(7,A)V'''' 


n 


Hence 


fcxG*-' (2 (2C'2(7,A)/n)i/"). 

This means that for A G (1/2,1] we obtain an error of order of magnitude 

^iQs,n,k'^ ^S,2,~/) ^i/(2A) 

under a construction cost of order of magnitude 

0{nG-\i2 ( 2 C 2 ( 7 ,A)/n))-'/") logn) 

for s arbitrarily large. A similar assertion holds for Hs^ 2 ,-y)- 

We end this section with the following examples. 
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Example 13 Assume that 7 j = j “ with a > 1. Then we have 

^ f'C 

j=k+l 

Hence we choose 


.00 1 ^ ^ 

■ dt = 


^2a 


2a - 1 ' 


and therefore 


G{x) = 


G-Ux) = 


2a — 1 

l/(2a-l) 


^ -iV 


2 a — 1 a; y 

This means that for A G (1/2,1] we obtain an error of order of magnitude 

1 


eiQlnM n,2,^) «,,A 


n 


1/(2A) 


under a construction cost of order of magnitude 

O lognj 

for s arbitrarily large. The same assertion holds for Hs^ 2 ,'y)- 

Example 14 Assume now that 7 ^- = for q G (0,1). Then we can take 


G{k) = 


<1 


k+l 


and 


G-Hx) = 


1 - q 
log(l/(a;(l - q))) 


log(l/g) 

This means that for A G (1/2,1] we obtain an error of order of magnitude 

1 

^iQs,n,k^ -^5,2,7) ^7,A 

under a construction cost of order of magnitude 

O [n log^(n)) 

for s arbitrarily large. The same assertion holds for Hs^ 2 ,-y)- 


7 Generalizations 

For simplicity of discussion, we presented so far the results for the domain D = [0,1], the 
standard Lp norm 

Ml, = \9{x)\P^x 
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and the un-weighted integration problem of approximating Xg. 

However, the resnlts of [H [10] on the eqnivalence of anchored and ANOVA spaces hold 
for more general domains and norms, as shown in [6|. Onr resnlts Theorem [H Proposition 
m Corollaries El and 0 and Theorem O can easily be extended to this more general setting. 
More specihcally let D be an interval 


D = [0,T] OT D = [0,oo), 


and let 

Ip D ^ M+ 

be a positive (a.e.) probability density fnnction. The anthors of [6] provide a necessary 
and snfficient condition on p G [1, C)o] and ip so that and Hg p -y are well dehned 

Banach spaces when endowed with the norms 




1/p 


-u])r 


and 


H s^'o.'y 




a3_u]) ip-\u\{x_^) da;_^ 


I DS-|U| 


1/p 


V’u(*u) da^i, 


respectively. Here 


jGu 


= YlP’iXj). 

For prodnct weights they show that 
lbs,i,7ll = lbM, 7 ll = + Ij and 


-1 


^S,CXD,7|| lrs,CXD,7 


jeu 


where 


= / xip{x)dx and = esssnp 


jGu 

jjjit-xf^ippt) dt 


ID xeD i>{x) 


and the npper bonnds for p G (1, oo) obtained via interpolation theory, see [6] for more. 
Let 

p \ D R+ 

be a probability density fnnction and let 

S 

Ps '■ ^ M+ be dehned by ps{x) = n p{Xj). 

i=i 


Consider now the integration problem of approximating 

^s,p(/) = f f{x)pg{x)dx 
J 0“ 
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for / G or f e Hs,p,-f. 
It is easy to verify that 


where 


\Ufn)\ < ll/^‘‘n[-u;0-u])IU„,(D^)l|/ill'^ 

„*\ 1/p* 


\h\\ = / 


ID 


{x — t)° p{x) dx 


ID 


Of course, for p = 1, we have 


h 


= ess sup 

teD 



t)+ p{x) dx 


1 . 


Therefore 


W^S 




Assuming that X* is continuous, i.e., ||Xs|| < oo, the results of Section 3 hold with 


- replaced by H/ip • 

p* + 1 

Finally we add that similar positive results for the dimension truncation can be ob¬ 
tained in other than the worst case settings and for other than integration problems 
including function approximation. These generalizations will be presented in our future 
papers. 
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